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METHOD AND SYSTEM FOR ENCAPSULATING CELLS 



■ 



TECHNICAL HELD OF THE INVENT ION 

This invention relates generally to the field of data communication and more 
specifically to a method and system for encapsulating cells. 

RACK GROU ND OF THE IN VENTION 

Encapsulating cells in a communication system may involve the use of multiple 
queues for buffering cells waiting to be encapsulated. Cells at different queues, however, 
may experience different waiting times prior to encapsulation, also known as cell delay 
variation. Cell delay variation may introduce unwanted jitter into the communication 
system. Moreover, encapsulation according to known techniques may result in sub- 
optimal bandwidth usage of a communications channel. Consequently, encapsulating cells 
while controlling jitter and enhancing bandwidth utilization has posed challenges. 

SI IMMARY OF THF. INVENTION 

In accordance with the present invention, disadvantages and problems associated 
with previous techniques for encapsulation of cells in data communication may be reduced 
or eliminated. 

According to one embodiment of the present invention, encapsulating cells 
includes receiving cells at a queue associated with decision points. Each decision point 
corresponds to a number of cells and is associated with a threshold criterion. The 
following operations are repeated until a threshold criterion is satisfied. A number of cells 
corresponding to a decision point are accumulated at a queue. Jitter associated with the 
cells at the queue is predicted, and it is determined whether the predicted jitter satisfies the 
threshold criterion associated with the decision point. If the predicted jitter satisfies the 
threshold criterion, the cells are sent to another buffer coupled to the queue. Otherwise, 
the cells continue to be accumulated at the queue. The cells in the buffer are encapsulated 

if certain criteria are satisfied. 

Certain embodiments of the invention may provide one or more technical 
advantages. A technical advantage of one embodiment may be that the number of cells to 
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be encapsulated is adjusted in response to predicted jitter, which may serve to control jitter 
while maintaining efficiency. If the predicted jitter is high, fewer cells are encapsulated ,n 
an effort to control jitter. If the predicted jitter is too low, more cells are encapsulated to 
m aintain efficiency. Another technical advantage of one embodiment may prov ld e 
prediction of jitter by estimating the number of cells at a buffer at a given lime. If the 
predicted number of cells is high, the jitter is predicted to be high. If the predicted number 
of cells is low, then the jitter is predicted to be low. 

Certain embodiments of the invention may include none, some, or all of the above 
technical advantages. One or more other technical advantages may be readily apparent to 
one skilled in the art from the figures, descriptions, and claims included herein. 



pPTPF DESCRIPTION HF THE DRAWINGS 

For a more complete understanding of the present invention and its features and 
advantages, reference is now made to the following description, taken in conjunction with 

1 5 the accompanying drawings, in which: 

FIGURE 1 illustrates a system for encapsulating cells to form encapsulation 

sections; 

FIGURE 2 illustrates a packetized encapsulation section; 

FIGURE 3 illustrates encapsulation sections for which cell delay variation may be 
20 calculated; 

FIGURE 4 is a flowchart illustrating a method for encapsulating cells; and 
FIGURE 5 is a flowchart illustrating a method for predicting jitter. 



25 



30 



DETAILED DE ^CR TPTTQN OF THE DRAW INGS 

FIGURE 1 illustrates a system 10 for encapsulating cells to form encapsulation 
sections. System 10 adjusts the number of cells waiting to be encapsulated at a queue in 
response to predicted jitter, which depends on the number of cells waiting to be 
encapsulated at other queues. By adjusting the number of cells to be encapsulated, system 
10 may control jitter while maintaining efficiency. In general, encapsulating a smaller 
number of cells reduces jitter, while encapsulating a larger number of cells improves 
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efficiency. System 10 predicts jitter and adjusts the number of cells to be encapsulated in 
order to reduce jitter while maintaining efficiency. 

System 10 receives cells from video flows 20 and data flows 22, encapsulates the 
received cells to form encapsulation sections, fragments the encapsulation sections into 
packets and transmits the packets to a receiver 32. A cell comprises a fixed-size packet. 
For example, a cell may comprise an asynchronous transfer mode (ATM) cell having a 
48-octet payload and a 5-octet header. Video flows 20 transmit video traffic, and data 
flows 22 transmit data traffic. According to one embodiment, video flows 20 may 
comprise ATM permanent virtual circuits (PVCs), and data flows 22 may comprise ATM 
PVCs. Flows that transmit other types of traffic such as voice traffic or other real-time 
traffic may be used in place of or in addition to video flows 20. 

System 10 may receive any suitable type of traffic, for example, moving pictures 
experts group-2 (MPEG-2) or MPEG-4 video traffic, voice over Internet protocol (VOIP) 
or Internet protocol (IP) packet traffic, or serial stream data carried in ATM cells. The 
15 traffic may be classified according to jitter tolerance. According to one embodiment, 
traffic that is jitter tolerant comprises data traffic, and traffic that is not jitter tolerant 
comprises video traffic. Jitter tolerant traffic, however, may comprise any traffic that is 
jitter tolerant according to any suitable definition of "jitter tolerant," and jitter intolerant 
traffic may comprise any traffic that is not jitter tolerant. For example, jitter intolerant 

20 traffic may include voice traffic. 

System 10 includes a switch 26 and an encapsulator 30. Switch 26 receives cells 
from video flows 20 and from data flows 22 and sends cells to encapsulator 30. Switch 26 
may comprise an asynchronous transfer mode (ATM) switch. Switch 26 includes a video 
buffer 34 and a data buffer 36. Video buffer 34 receives cells from video flows 20, and 
data buffer 36 receives cells from data flows 22. Switch 26 may implement a scheduling 
priority that favors the jitter intolerant traffic from video flows 20 over the jitter tolerant 

traffic from data flows 22. 

Encapsulator 30 generates encapsulation sections from cells received from switch 
26. Encapsulator 30 includes an interface card 38, video queues 40, data queues 41, a 
30 processor 43, a real time buffer 42, a non-real time buffer 44, and a scheduler 46. 
Interface card 38 buffers cells received from switch 26, and transmits the cells to video 
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queues 40 and data queues 42. Interface eard 38 may eompnse, for example, an 
asynchronous transfer mode (ATM) network interface card. 

Video queues 40 buffer video traffic, and data queues 41 buffer data traffic. Each 
video queue 40 stores video traffic sent from a video flow 20 associated with the v.deo 
5 queue 40. According to one embodiment, queues that queue other types of traffic such as 
voice traffic or other real-time traffic may be used in place of or in addition to video 
queues 40. Similarly, each data queue 41 stores data traffic sent from a data flow 22 
associated with the data queue 41. As used in this document, "each" refers to each 
member of a set or each member of a subset of the set. 
10 Processor 43 manages the encapsulation process. When the number of cells at a 

video queue 40 reaches a threshold value, the cells are formed into an encapsu.at.on 
section Processor 43 determines the target value in response to predicted jitter, wh.ch 
depends in part on the number of packets at real time buffer 42. Jitter is measured by 
calculating the cell delay variation between the input to switch 26 and the input to receiver 
15 32. Data queues 41 may form encapsulation sections from the data cells in a similar 

manner or in another suitable manner. 

Encapsulation sections from queues 40 and 41 are packetized into packets. Packets 
of video encapsulation sections are copied into real time buffer 42, and packets of data 
encapsulation sections are copied into non-real time buffer 44. The packets of an 
20 encapsulation section may be copied sequentially into real time buffer 42 or non-real time 
buffer 44 such that the packets are not interleaved by packets of another encapsulate 
section. An example of a packetized encapsulation section is described with reference to 
FIGURE 2 According to one embodiment, buffers that buffer other types of traffic such 
as voice traffic or other real-time traffic may be used in place of or in addition to real t,me 
25 buffer 42. 

Scheduler 46 outputs video encapsulation sections from real time buffer 42 and 
data encapsulation sections from non-real time buffer 44. Real time buffer 42 may be 
given scheduling priority over non-real time buffer 44 such that packets are transmitted 
from non-real time buffer 44 only if real time buffer 42 is empty. Accordingly, non-real 
30 time buffer 44 is sufficiently large to store delayed data encapsulation sections. Real time 
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buffer 42 and non-real time buffer 44 may process the packets according to a first-in-first- 
out procedure. 

To summarize, system 10 encapsulates cells to form encapsulation sections. The 
number of cells to be encapsulated at each video queue 40 is adjusted in response to 
predicted jitter, with the goal of reducing jitter while maintaining efficiency. Jitter may be 
measured by calculating cell delay variation, to be described with reference to FIGURE 3. 
A method for determining when to encapsulate cells is described with reference to 
FIGURE 4. Predicting cell delay variation involves calculating the number of packets 
predicted to be at real time buffer 42, to be described with reference to FIGURE 5. The 
encapsulation sections are fragmented into packets, which are transmitted to receiver 32. 
Cells and packets comprise fixed-size packets, where the size of a cell may differ from the 
size of a packet. 

The following parameters may be used to perform calculations described in the 
examples illustrated with referenc e to FIGURES 3 through 5. 
Parameter 1 Definition 

Total number of flows 20 a nd 22 
Number of video flows 20 



n 



nd 



Mi(k) 



Number of data flows 22 

Number of cells in the *th encapsulation section 200 of the ith 
flow 



CDV, 



sw 



L 5W 



~CDV card 



Worst-case cel l delay variation for video traffic at switch 26 
Switching capacity of an output port of switch 26, in bits per 
second 



Worst-case cell delay variation for video traffic up to interface 
card 38 within encapsulator 30 



Rcard 
U card 



Processing capacity of interface card 38, in bits per second 



Worst-case interdeparture time for two successive cells of the ith 
video flow 20 



R 



encap 



Rate of encapsulator 30, in bits per second 



Mi 



Size of the paytoad portion of an encapsulation section from the 
fth video flow 20 



CDV. 



encap 



Worst-case positive cell variation up to and including 
encapsulator 30 



Rj | "Allocated bandwidth to the ith video flow 20, in bits per second 

-jjwj I Bandwidth efficiency for an encapsulation section of size M 

M hieh - tw/MJ 1 Optimal size of a payload portion 
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M mi: d 
Mlow 



rtUoi 



Qrt 



Size of a payload portion at a first decision point 
Siz e of a payload portion at a second decision poi m 
Total number of cells in n v video queues 40 



FIGURE 2 illustrates a packetized encapsulation section 200. Encapsulation 
section 200 includes a section header 210, section data 212, and a section footer 214. 
Sect.on header 210 may include, for example, digital video broadcasting (DVB) Multi- 
5 Protocol Encapsulation (MPE) header data. Section data 212 includes packets 216. 
According to one embodiment, encapsulation sect.on 200 may comprise a multiprotocol 
encapsulation (MPE) section. A packet 216 includes a packet header 218, packet data 220, 
and a packet footer 222. Packet data 220 includes cells. Section footer 214 may mclude, 
for example, error correction codes. According to one embodiment, each packet 216 may 
10 comprise a 204-byte MPEG-2 packet. Packet header 218 has eight bytes, packet data 220 
has 104 bytes, packet footer 222 has eight bytes, and four bytes are used for control 
purposes. 

According to one embodiment, header compression may be used when 
encapsulating the cells. The header of each cell is removed and the payload of the cell is 
15 inserted into packet data 220. Relevant information from the cell header is encoded into a 
control cell of the encapsulation section 200. 

FIGURE 3 illustrates encapsulation sections 200 for which cell delay variation 
may be calculated. The equations presented in the illustrated example apply to an 
embodiment according to which ATM cells and MPEG-2 packets are used. Other 
20 equations, however, may be used for other embodiments according to which other cells or 
packets are used. According to one embodiment, encapsulation sections 200 are at the ifh 
video queue 40, where i -I,.... n v , referred to as queue i. Capacity R, is the bandwidth 
allocated to queue i. The worst-case cell delay variation CDV» that queue i experiences 
at switch 26 may be described by Equation (1): 
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CDV ( ;l = 53 x 8 x nJR m = 424nJR sw ^ 
where R sw is the switching capacity of an output port of switch 26. The next buffering 
stage occurs at interface card 38 of encapsulator 30. 

The cell delay variation CDV^ up to and including interface card 38 may be 

described by Equation (2): 

CDV = 424«/Rc^ (2) 
where R card is the processing capacity of interface card 38. After leaving interface card 38, 
the worst-case interdeparture time , or delay time, for two successive cells of flow i 
may be described by Equation (3): 

D ^ = 424nJR card + 424/*,- < 3 > 
15 The worst-case interdeparture time for two successive cells at the output of 

encapsulator 30 occurs when the first cell of two successive cells happens to be the last 

cell of the Ath encapsulation section, while the second successive cell is the first one of 

the (ifc+l)th encapsulation section. In the illustrated example, first cell 250a is the last cell 

of Mi encapsulation section 200a, and second cell 250b is the first cell of the (*+l)th 

20 encapsulation section 200b. 

If the first bit of first cell 250a arrives at queue i at time /, the last bit of first cell 
250a arrives at time t+ 424/iW According to one embodiment, the time needed to 
compute header 210 and footer 214 for encapsulation section 200 and to insert cells 250 
into encapsulation section 200 is assumed to be small compared to the waiting time of 
25 cells 250 at queue i. Similarly, the time needed to generate packet header 21 8 and packet 
footer 222 of packet 216 is assumed to be small. To compute the worst-case 
interdeparture time at the output of encapsulator 30, the difference between the earliest 
possible departure time for the last bit of first cell 250a and the latest possible departure 
time for the last bit of second cell 250b is computed. 
30 Once the last bit of first cell 250a arrives at the queue i, header 210a and footer 

214a for the *th encapsulation section 200a are computed, and encapsulation section 200a 
is packetized into the number of packets 216a given by Equation (4): 
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Number of packets 216a in the ton encapsulation section 200a - 



48M,(/r) + 16 
184 



(4) 



where f ] is the ceiling function. If the cell headers are compressed, encapsulation section 

200 includes Mflt) cells 250 having a control cell that describes the header information of 

subsequent cells 250 of encapsulation section 200 plus M,(fc)-1 cells with no headers. In 
5 the illustrated example, the 16-byte term in the numerator is the contribution of 

encapsulation section header 210 and footer 214, and the 184-byte in the denominator is 

the size of packet data 220 of packet 216. 

In the best-case scenario, packets 216 of the kth encapsulation section 200a are 

immediately sent from encapsulator 30. Accordingly, the earliest possible departure time 
10 of the last bit of first cell 250a may be given by Equation (5): 

Earliest departure time of last bit of first cell 250a 

48M.(*) + 16 



(8X204) 

424 

= f + + 



184 



(8)(16) 



(5) 



Rcard Rencap Rencap 

where R encap is processing capacity of encapsulator 30. The last term in the right-hand side 
of Equation (5) represents the time needed to transmit footer 214a and packet footer 222a 
1 5 of last packet 2 1 6a, which are transmitted after the last bit of first cell 250a. 

In the worst case, the first bit of second cell 250b arrives at video queue 40 at time 
D card and the last bit arrives at time t + D canl + 424/*«„* Second cell 250b waits at queue i 
for the arrival of M,{l+k) -2 additional cells to complete encapsulation section 200b. 
According to one embodiment, the M,{l+k) cells may include a control cell. Accordingly, 
20 the last bit of the last cell of the (1+Jfc)th encapsulation section 200b becomes available in 
queue i at time t + D card (M,{\+k)-\) + AlAIRcwd- Once the last bit becomes available, the 
(1+Jt)th encapsulation section 200b may be constructed. The copying of newly formed 
packets 216 into real time buffer 42 and non real time buffer 44 is assumed to be done at a 
rate faster than Rencap- 

25 In the worst case, the (1+Jfc)th encapsulation section of queue i has to wait for the 

transmission of n v -1 encapsulation sections from other queues j, where j=l, . . ., « v and 
j*i plus the transmission of packet 216 from non-real time buffer 44, due to the 
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nonpreemptive nature of scheduler 46. Mj indicates the generic size of an encapsulation 
section from queue/ The first bit of the (l+*)th encapsulation section 200b of queue / is 
transmitted from encapsulator 30 no later than as described by Equation (6): 
Latest transmission time of the first bit of the (1 + *)th encapsulation section 200b = 

, , , , 424 (8)(204)&.^1 + (204X8) 
r + D (,) .(M,(l+*)-l)+ + + w 

card Rc(jrd Rencap Rencap 

Within the (l+*)th encapsulation section, second cell 250b is preceded by header 
218b of the first packet 216b, a control field of packet 216b, header 210b, and a control 
cell. According to one embodiment, packet header 218b comprises eight bytes, the control 
field comprises four bytes, header 210b comprises eight bytes, and the control cell 
comprises 48 bytes. The latest transmission time of the last bit of second cell 250b may be 

described by Equation (7): 

Latest transmission time of last bit of second cell 250b = 

424 (8)(204)Sy, ,[^1 (204)(8) (ll6)g) 
card Rmrd Rencap Rencap Rencap 



Rcard Rencap 

,(<> 



From Equations (5) and (7), the worst-case interdeparture time DJ ncap at the output 
of encapsulator 30 may be described by Equation (8): 



\ 1632 



encap 



z 



J*> 



4SMj + 16"| r 48M,.(fc) + l6 

j 184 



+ 1.647 



(8) 



184 

cell delay variation CDV^P to and including encapsulator 30 may be 



The worst-case 
given by: 

(9) 



CDV^D^AIAIR, 

As an example, the worst-case situation occurs when the M-value is set to its 
maximum possible size for all encapsulation sections 200. In this case, Equation (8) 
reduces to Equation (10): 
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WL,)-* = 84D - {230,-2) + l-647} 



(10) 



-84DW,+-^(23«.-44.353) 

en cap 



When the (l+*)th encapsulation section 200b of queue i is to be encapsulated, the only 
factor of Equation (8) that may be controlled is M^k). Th.s may be used to reduce the 

5 worst-case cell delay variation. 

Cell delay variation is negatively impacted by larger M-values. Reducmg the M- 
value, however, may have an adverse effect on bandwidth efficiency since such reduction 
typically increases the relative overhead of encapsulation. To demonstrate tins 
relationship, variable M is used to describe the M-value of a given encapsulation section 
0 200 Bandwidth efficiency is defined as the ratio between the number of payload 

bytes of an encapsulation section 200 and the total number of bytes used to transport 
encapsulation section 200 from encapsulator 30. According to one embodiment, the 
payload bytes refer to ATM traffic bytes at the input of encapsulator 30 that are needed to 
generate an encapsulation section 200. Accordingly, bandwidth efficiency may be 
1 5 calculated using Equation (1 1): 

, , 53( M-l) OD 
^ M)= r 4 8M+l6 



184 



where T(48M +16/184)] is the number of packets 216 of an encapsulation sechon 200, 
and M-l is the number of payload cells of an encapsulation section 200. 
20 In general, the larger the M-value, the higher is the efficiency. The trend, however, 

is not monotonic due to the ceiling function of Equation (11), which is attributed to the 
padding of unused bytes in packets 216. As a result of this padding, for ATM cells the 
optimum efficiency is achieved at M = 84 and is described by EquaUon (12): 

(12) 

25 ^(M)=r,(84)=98.02% 
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Near-optimal efficiency may be achieved using certain values of M that are significantly 

less than 84, for example, M= 36 or M=\5. 

FIGURE 4 is a flowchart illustrating a method for encapsulating cells. According 
to the method, each video queue 40 is associated with a number of decision points. In the 
illustrated example, each video queue 40 is associated with three decision points, M loM 
M medium , and Mhigh- A decision point refers to a number of cells at a video queue 40. When 
video queue 40 reaches a decision point, a decision on whether to encapsulate the cells at 
video queue 40 is made based on the activity at the other video queues 40 and real time 
buffer 42. Typically, high activity at other video queues 40 and real time buffer 42 
indicates the potential for high jitter. If the activity is high, indicating that predicted jitter 
may be high, then the cells are encapsulated in order to control jitter. If the activity is low, 
indicating that predicted jitter may be low, encapsulation is deferred in order to gain 
transmission efficiency. According to one embodiment, each decision point may be 
associated with an optimized efficiency such that encapsulating the number of cells at the 
decision point may provide for maximized efficiency. Data without quality of service 
constraints may be encapsulated at the maximized efficiency, and data with quality of 
service constraints may be encapsulated at the maximized efficiency with respect to the 
quality of service constraints. 

Activity may be measured by predicting a number of packets Qtf at real time 
20 buffer 42, which includes the number of packets already at real time buffer 42 plus the 
number of packets expected to arrive at real time buffer 42 from other video queues 40. 
Threshold values may be used to determine whether the activity at video queues 40 and 
real time buffer 42 is sufficient to encapsulate cells. For example, if the number of 
packets QS? satisfies a threshold value, encapsulation is performed. In the illustrated 
example, each video queue 40 is associated with a first threshold and a second threshold. 
The first threshold is used at decision point M low to determine if encapsulation should take 
place at M low or M^, and the second threshold is used at decision point M mat to determine 
whether encapsulation should take place at M me a or M h i S i,. 

The method begins at step 300, where cells are accumulated at video queue 40. 
30 The number of cells at video queue 40 is checked at step 302. If the number of cells has 
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not reached decision point Mw, the method returns to step 300 to continue accumulate 
cells at video queue 40. If the number of cells has reached decision point M low , the method 
proceeds to step 304 to predict the number of packets that will be at real time buffer 42. 
The number of packets may be predicted acceding to a method described with reference 
5 to FIGURE 5. If the predicted number satisfies a first threshold at step 306, the method 
proceeds to step 308 to encapsulate a small encapsulation section that includes M low cells. 
After encapsulating the small section, the methods terminates. 

If the predicted number does not satisfy a first threshold at step 306, the method 
proceeds to step 310 to continue to accumulate cells at video queue 40. The number of • 
10 accumulated cells is checked at step 312. If the number of cells has not reached decs.on 
point M med , the method returns to step 310 to continue to accumulate cells at video queues 
40 If the number of cells has reached decision point M med , the method proceeds to step 
314 to predict the number of packets at real time buffer 42. If the predicted number 
satisfies a second threshold at step 316, the method proceeds to step 318 to encapsulate a 
15 medium sized encapsulation section. After encapsulating the cells, the method terminates. 

If the predicted number does not satisfy the second threshold at step 316, the 
method proceeds to step 320 to continue to accumulate cells. The number of cells is 
checked at step 322. If the number of cells has not reached decision point Mugh, the 
method returns to step 320 to continue to accumulate cells. If the number of cells has 
20 reached decision point M high , the method proceeds to step 324 to encapsulate a large s,zed 
encapsulation section. After encapsulating the cells, the method terminates. 

FIGURE 5 is a flowchart illustrating a method for predicting jitter. The method 
predicts a number of packets Qff* real time buffer 42, which is used to determine 
whether to encapsulate cells located at queue i. According to the method, a fill time 
25 matrix Aj describes the time for other queues," to reach decision points, while takmg into 
account the bandwidth allocated to the flow 20 associated with queue/ The pred.cted 
number of packets at real time buffer 42 is determined using the current number of 

packets and fill time matrix Aj. 

The method begins at step 400, where fill time matrix Aj is initialized. Each queue 
30 j may be associated with a fill time matrix Aj that has two columns. In a completed fill 
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time matrix Aj, the first column describes fill times, and the second column describes 
additional packets 216 produced by each fill. Element A/p. f) is the (p. g)th element of 
Aj. 

In the illustrated example, the decision points comprise M low , M med , and M„ igh . The 
5 decisions are made when the number of cells M h at queue « reaches M low -1 and M med -1 . 
A decision point is selected at step 402. If the number of cells M at queue i is equal to 
M low -1, a decision is made whether to encapsulate using M = M tow or to continue 
accumulating cells until the next decision point is reached. To determine whether to 
encapsulate, the impact of waiting for the next decision point on the cell delay variation ,s 
10 assessed. 

A waiting period is calculated at step 404. If encapsulation is postponed until m,= 
M mai -1, then in the worst case queue i has to wait for the period IF«— described by 
Equation (13): 

^<2-w = -WJOU = 2U><2< seconds (13) 

15 During the waiting period, other queues./ may reach their respective decision points and 
may encapsulate using any of the three M-values. One of the other queues," is selected at 
step 405 to determine the impact of the activity at queue j on cell delay variation. The 
maximum number of cells that could arrive at queue, within W^ mei time period is given 

20 by ^2^^ /424 = 212)^^ /424. There are three possibilities to be considered, 
depending on the fill status of queue j: m j > M mal , M low <m } <M mcd -1, and 
rrij <M low -\. 

Fill times for a queue j with m } > M med are calculated at step 406. If > M med , 
the next decision point for queue j occurs at M high . The earliest time by which such 
25 encapsulation could take place is given by 424 (M A/gA - m, - 1)% ^ hus ' lf 
w& > 424(M . -m. -l)/Ri „ then in the worst case queue, could generate at least 

' r low-* med ~ v ht 8" J ' J 

one encapsulation section before queue « reaches its fill level of M med -1. If that happens, 
queue, generates r(48x84 + 16)/184l = 22 packets 216 into the real time buffer 42, and 

starts filling again. 



BNSDOCID-. <WO 03103241A1_I_> 





PCT/US03/14827 
WO 03/103241 



14 



In the worst case, subsequent encapsulations at queue; within the F^.., period 
are performed using M low . Thus, the maximum number of encapsulation sections 200 that 
m ay be produced from queue,' dunng the W^ med period is described by Equation (14): 



f i i w (n ^ = 1 + 

J high \J * to\«-*mcd t 



M low ~ 1 



(14) 



where |J is the floor function. As mentioned above, the first fill results in twenty-two 
packets 216, and each subsequent fill produces [(48,15 + 16)/ 184] = 4 packets 216. The 
earliest time for producing the first fill occurs after the interval described by Equation 



10 (15): 



., 424(^-^-1) seconds (l5 ) 
Subsequent fills occur at intervals described by Equation (16): 

5 

T ,„ Vn _ 424(Mw-l) _5936 wmdsfcrB .2A..,/*0.lC--) < 16) 

- »u %a <r »t <? Kf -1 are calculated at step 408. If 
Fill times for a queue , with M low <mj<M med i arc 

20 < m . <M med -1, the next decision point for queue j occurs at M med . The earliest 

timl by which such encapsulation could take place is given by 424 (M med - mj -Wj 
seconds. Thus, if W«_ med > 424^ - mj - W.then in the worst case queue, generates 
at least one encapsulation section before queue i reaches its fill level of M med -1. If that 
happens, queue," generates [(48 x 36 + 16)/ 184 1 = 10 packets 216 into real time buffer 40, 

25 and starts filling again 

In the worst case, subsequent encapsulations at queue during W lo ^ med time 

period are performed using M low . Thus, the maximum number of encapsulation sections 
200 that may be produced from queue during the W^ med period is described by 
Equation (17): 
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10 



15 



20 



fmcd 0 » ^tow-tincd ) ^ 



^■:.L„^./424-(M a , td -l-m > ) 



(17) 



Except for the first fill wh.ch produces ten packets 216, every subsequent fill produces 
5 four packets 216. The earliest time for producing the first fill occurs after the interval 
described by Equation (18): 

m = 424(M med -r»j-\) seconds (1 8) 

1 med \J f flj 

Subsequent fills occur at intervals described by Equation (19): 

T (-) , ,-\ = 424(M W -1) = 5936 seconds for m = ^ _ (>> ^rW^ ) (19) 

WJ Rj Rj 

Fill times for a queuey with m, < M low -1 are calculated at step 410. If my < M /o „ -1, 
the next decision point for queue j occurs at M low . The earliest time such encapsulation 
could take place is given by 424(M, 01V - m, - Wj seconds. Thus, if > 424(M /<W - 

^ - \)/Rj, then in the worst case queue, could generate at least one encapsulation section 
before queue i reaches its fill level of M med -1. If that happens, queue j generates four 
packets 2 1 6 into real time buffer 40, and starts filling again 

In the worst case, subsequent encapsulations of queue j during the W^ med period 
are performed using M low . Thus, the maximum number of encapsulation sections 200 that 
may be produced from queue," during the W^ me4 period is described by Equation (20): 



flowU^iow-*med) ~ ^ + 



Mlow — 1 



(20) 



25 The earliest time for producing the first fill occurs after the interval described by Equation 
(20): 

Cu) _424(Mow-m>-l) secQnds (21) 
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Subsequent fills occur at intervals described by Equation (22): 

424(^-1) _ 5936 seconds for w = 2,3,...,/ /ow O,<2^) < 22 > 

how U)- R . Rj 

Fill matrix Aj for queue, is updated at step 412 with fill times determined at steps 
406 through 410. The estimated worst-case scenario for the generation of packets 216 
from queues; - 1. . . . ,n v J * i is used to predict the status of real time buffer 42 after the 
W« time period. The evolution of the number of packets at real time buffer 42 is the 

rr !ow—*med ' 

same as that of a batch IDI\ queuing system with known starting times and 

heterogeneous inputs, that is, where the interarrival times of each input are deterministic 
but vary from one input to another. Except for the first fill of each input, the batch s.ze .s 
fixed at four packets. In the illustrated example, the time to serve a packet is g.ven by 
1632//W seconds, which is selected as a time slot. The first column of each matrix Aj 
m ay be normalized so that the time for each fill is indicated in the number of time slots. 
5 The floor function may be taken to produce an integer number of time slots. 

If there is a next other queue, at step 414, the method returns to step 405 to select 
the next other queue,. If there is no next other queue, at step 414, the method proceeds to 
step 416 to determine the current number of packets Q RT in real time buffer 40. The future 

. t n p'«> W w R.*r«n /1632 time slots is predicted using the 

number of packets Q% T alter w lovl ^ mei ^encap 

« current number of packets Q RT at step 418. The growth of real time buffer 42 may be 
simulated for the number of time slots using fill time matrix Aj for jj 1 1 The followmg 
procedure may be used to predict fig- . In the procedure, the parameter next J*//[/] 
provides the index to the next fill time at queue,'. 

initialize Qff* := Qrt 
25 set S max := »£w W"32 /* maximum number of slots / 

for,'=l,.-.,«v,,"*'> do 

set next Jill\j] = 1 
end-for 

fort = 1,2, . . - ,Sm«,do 
30 for j - 1, 2, . . . , n^j * i, do 

if Aj (next Sill\j\, 1) = t 



C <WO 03103241A1_L> 



WO 03/103241 



PCT/US03/14827 



10 



17 

Qg* := Qg* + Aj{nextjill\jl 2) 

increment next JiH\j] 

end-if 
end-for 

end-for 

The worst-case extra delay caused by postponing encapsulation at queue i may be 
estimated using Equation (23): 

= (8X204Xg.y-QT) + DZ {Mmed _ Mw ) (23) 



low~+med n 



The prediction is reported at step 420. The decision whether to encapsulate using 
M low or not can be made by comparing fi£- to a threshold A^-*™*/ described by 
Equation (24): 



— V 

low-tmed Z-J 



48 J /W_.„+16 



"V 

= z 



48(36) + 16 
184 



= 10(« v -1) 



(24) 



def 

184 

15 7=1 

j*i 

If 0 H > N low -+ med , encapsulation section 200 is formed using M low . Otherwise, 
encapsulation is postponed until the next decision point. After reporting the predicted 

value, the method terminates. 

If decision point M med is selected at step 402, the decision was made to not 
20 encapsulate using M lom but to wait until mr M med -1 . At m, = M med -1, a decision is made 
whether to proceed with encapsulation using M med or to wait until m ( - = M high -1- The basis 
for making such a decision depends on the impact of waiting on the cell delay variation at 
encapsulator 30. 

A waiting period is calculated at step 404. If encapsulation is postponed until m, = 
25 M high -1, then in the worst case queue i has to wait for the period W^ high described by 
Equation (25): 

W^ bigh = (M ugh -M med )D^ = 48Z>^ seconds (25) 
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During the waiting penod, other queues, may reach their respective fill levels and may 
encapsulate using any of the three M-values. One of the other queues," is selected at step 
405 to determine the impact of the activity at queue j on cell delay variat.cn. The 
maximum number of cells that could arrive at queue, within the W«_ high time penod ,s 

u arm r /424 = 48D (i > R -/424. There are three possibilities to be 
5 given by W^ Ugi Rj l*** - ^^card^i 

considered depending on the fill status of queue,: m, > M med , M low < mj < M med , mj < M low . 

Fill times for mj > M med are calculated at step 406. If mj > M med , the next dec. S1 on 
point for queue, occurs at M high . The earliest tune by which such encapsulation could take 
place is given by 424(M^ - mj - * *«U. * ***** " * " the " 

10 generates a maximum of /**0. W^ Mgh ) encapsulation sections 200 within the W%_ high 



period, where f Mgh is described by Equation (26): 



fhigh U> ^med-*high ) ^ + 



WHL-±ki<.i,Ri / 424 - (Mhigh - 1 - mi) 

Mlow — 1 



(26) 



15 



20 



As discussed previously, the first encapsulation section has twenty-two packets 216, 
while each subsequent encapsulation section has four packets 216. At best, encapsulation 
sections are generated at times O,), + 

iS(/>+iS</>+«u>, - - • . where is described b * Equations (15) ™ d (l6X 

for m = 1 and m > 1 , respectively. 

Fill times for M low < mj < M med -1 are calculated at step 408. If W^ high > 424 
{Mmed - mj - Oflfc then in the worst case queue," produces at least one encapsulation 
section within a W^ Ugh period, and may produce a maximum of f med U, W«_ high ) 
encapsulation sections, where/.* is described by Equation (27): 



25 



fmeJjy ^med-^high^ * + 



W^^R^lA-iM^-l-m,) 



(27) 



The first encapsulation section 200 yields ten packets 216 in real time buffer 40, while 
each subsequent encapsulation section 200 yields four packets 216 in real time buffer 40. 
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The inter-generation times of the encapsulation sections from the queue j are given in 

Equations (18) and (19). 

Fill times for mj < M low -1 are calculated at step 410. If W^ high > 424 (M low - mj 

. l)/Rj, then in the worst case the queue j generates a maximum of f,„Jj, W^ his „) 
encapsulation sections before the queue i reaches its fill level of M higl , -1. where/,, is 
described by Equation (28): 



W«L^RjlM-W lml -\-m» 



(28) 



Each encapsulation sect.on 200 is packetized in four packets 216. The generation t.mes for 
10 these encapsulation sections may be obtained from Equations (21) and (22). Informal 
about fill times and the potential number of generated packets is stored in fill time matnx 
A-* step 412. If there is a next other queue j at step 414, the method returns to step 405 to 
select the next other queue,. If there is no next other queue, at step 414, the method 
proceeds to step 416. 

The current number Q KT of packets in real time buffer 42 is determined at step 416. 
The predicted number Qfi- packets in real time buffer 42 is predicted at step 418 from 
the current number Q RT and the fill matrices. The procedure described previously, but 
with replacing W^ med in the second line, may be used to compute the 

predicted number Q%* representing the number of cells after W^m P eriod - ° nce 
20 flfi- ^ obtained, the worst-case extra delay caused by postponing the encapsulation 
decision at queue i may be estimated using Equation (29): 

(0 = (8X204Xgg -Q*'KD2 rA M high -M med ) (29) 

w med -thigh D 

^eneap 

The predicted value is reported at step 420. The decision whether to encapsulate 
25 using M merf or not may be made by comparing QS? to the threshold N med -+ high , described 
by Equation (30): 
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N 



dcf 



mcd-*liigh 



z 



48M /o>y +16 



184 



"V 

I 



"48(15) + 16 



184 



= 4(»„ - 1) 



(30) 



If QST >-N^ an encapsulation sect.cn is fonned using M med cells. Otherwise, 
encapsulation is postponed until m > = M hig ,X. After reporting the predicted value, the 
method terminates. 

Encapsulating cells according to the illustrated method may reduce jrtter whde 
maintaining efficiency. If an encapsulation section 200 from queue , is fonned usmg M, 
cells then the worst-case interdeparture time at the output of encapsulator 30 may be 
obtained using Equation (8) by substituting M low for M,<1 + *), M high for Mj, and M low for 
M,{k), yielding Equation (31): 



^ encap {J* 1 



(48)(84) + 16~ 



184 



(48)(15) + 16l 



184 



+ 1 .647 



= 14^iL + 



1632 



R 



{22n v -24.353) 



(31) 
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If encapsulation is postponed until m t = M mat -1, then the worst-case interdeparture 
time is upper bounded as described by Equation (32): 



15 



1632 



R 



Q 



pred 

RT 



encap 



(48)(15) + 16 



184 



+ 1.647 



<35£> 



(•') 

card 



= 35D^ + 



— {l0(« v -l)-2.353} 



(32) 



R 



encap 



1632 



R 



(lOnv-12.353) 
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The first term of the right-hand side of Equation (32) is the result of having to wait for the 
arrival of M med -1 cells before encapsulation. The other terms account for the unpact of 
encapsulation sections 200 from queues,' other than queue i and for the impact of the 
previous encapsulation section 200 from queue /. 

Finally, if encapsulation is postponed until m, = M high - 1, then the worst-case 
interdeparture time is upper bounded as described by Equation (33): 
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1632 ~pred 



QTr - 



(48)(15) + 16 
184 



+ 1 .647 



cncop 

1632 ^/ (33) 



<83Z><* + — {4(„ v -l)-2.353} 



card 

l\encap 



= 83^2. +— (4«v-6-353) 



a " J R 



encap 



The worst-case cell delay variation for the M-values may be obtained from Equation (9) 
5 by replacing D«, by the corresponding worst-case interdeparture time at the given M- 
value The reduction in cell delay variation is the highest when M low is used and the 
,owest when M Mgh is used. The average reduction in cell delay variation depends on the 
distribution of encapsulation sections 200 that are encapsulated using M low . M med , and 
M, igh which in turn depends on the traffic conditions, because the heavier the load, the 
l0 higher is the tendency to encapsulate using a larger M-value. If the load is light for a large 
fraction of the time, then most of the encapsulation sections are encapsulated using M Mgh 

and to a lesser extent M me d- 

If the resulting cell delay variation bounds are too loose, then one can control these 

bounds for both M med and M high by modifying the values of N l0 ^ med and N ned _ high . For 
15 example, using a smaller value for N^ med than the one used in Equation (24) mcreases 
the number of encapsulation sections that are encapsulated using M low , and hence 
decreases the average worst-case cell delay variation. According to one embodiment, the 
sizes of the encapsulation sections may be monitored, and the thresholds and 
N^ Mgh may be adjusted so that a desired cell delay variation performance may be 
20 provided. 

Certain embodiments of the invention may provide one or more techn.cal 
advantages. A technical advantage of one embodiment may be that the number of cells to 
be encapsulated is adjusted in response to predicted jitter in an effort to control jitter whxle 
maintaining efficiency. If the predicted jitter is high, fewer cells are encapsulated to 
25 control jitter. If the predicted jitter is too low, more cells are encapsulated to mamtam 
efficiency. Another technical advantage of one embodiment may provide predion of 
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jitter by estimating the number of cells at a buffer at a given time. If the predicted number 
of cells is high, the jitter is predicted to be high. If the predicted number of cells is low, 

then the jitter is predicted to be low. 

Although an embodiment of the invention and its advantages are described in 
detail, a person skilled in the art could make various alterations, additions, and omissions 
without departing from the spirit and scope of the present invention as defined by the 
appended claims. 
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what l£ CLAIMED IS : 

I A method for encapsulating cells, comprising: 

receiving a plurality of cells at a queue, the queue associated with a plurality of 
decision points, each decision point corresponding to a number of cells, each deepen 
5 point associated with a threshold criterion; 

repeating the following until satisfying a threshold criterion: 

accumulating at the queue a number of cells corresponding to a dec, S1 on 

point; 

predicting jitter associated with the cells; 
10 determining whether the predicted jitter satisfies the threshold criterion 

associated with the decision point; 

sending the cells to a buffer coupled to the queue if the predicted jitter 

satisfies the threshold criterion; and 

continuing to accumulate at the queue a number of cells corresponding to a 

1 5 next decision point; and 

encapsulating the cells at the buffer. 

2 The method of Claim 1 , wherein: 

predicting jitter associated with the cells comprises predicting a number of packets 

20 at the buffer; and 

determining whether the predicted jitter satisfies the threshold criterion associated 

with the decision point comprises determining whether the predicted number satisfies the 
threshold criterion, the threshold criterion describing a threshold number of packets at the 
buffer. 
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3. The method of Claim 1 , wherein predicting jitter associated with the cells 
^^accessing a fill time matrix associated with another queue, the fill time matrix 
comprising a plurality of fill umes, each fill time associated with a set of packets sent to 

5 the buffer from the other queue; 

determining a current number of packets at the buffer; and 

predicting the number of packets according to the current number of packets at the 
buffer and the fill time matrix in order to predict the jitter associated with the cells. 

The method of Claim 1, wherein predicting jitter associated with the cells 



10 4. 



15 



comprises: 

accessing a plurality of fill time matrices associated with a plurality of other 
queues, each fill time matrix comprising a plurality of fill times, each fill time associated 
with a set of packets sent to the buffer from the associated other queue; 

determining a current number of packets at the buffer; and 

predicting the number of packets according to the current number of packets at the 
buffer and the fill time matrices in order to predict the jitter associated with the cells. 



5. 



The method of Claim 1, further comprising calculating a fill time matrix 

20 associated with another queue by: 

calculating a waiting period between encapsulating at a current decision point and 

encapsulating at a next decision point; 

determining information about a plurality of sets of packets sent to the buffer from 
the other queue during the waiting period, each set of packets associated with a fill tune; 
25 and 

storing the information in the fill time matrix, the fill time matrix used to predict 
the jitter associated with the cells. 

6 The method of Claim 1, wherein encapsulating the cells at the buffer 
30 comprises encapsulating the cells to generate a multi-protocol encapsulation section. 
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7. The method of Claim 1. wherein encapsulating the cells at the buffer 
comprises: 

generating an encapsulation section by adding a section header and a sect.on footer 
to the cells; and 

5 packetizing the encapsulation section into a plurality of packets, each packet 

comprising a packet header and a packet footer. 

8. The method of Claim 1 , wherein: 

each decision point comprises an optimized efficiency; and 

encapsulating the cells at the buffer comprises encapsulating the cells at a 
maximized efficiency. 



10 
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9. The method of Claim 1 , wherein the cells comprise traffic selected from a 
group consisting of video traffic, voice traffic, and real-time traffic. 

1 0 A system for encapsulating cells, comprising: 

a queue receiving a plurality of cells, the queue associated with a plurality of 
decision points, each decision point corresponding to a number of cells, each decision 
point associated with a threshold criterion; and 
20 a processor coupled to the queue and operable to: 

repeat the following until satisfying a threshold criterion: 

accumulating at the queue a number of cells corresponding to a 

decision point; 

predicting jitter associated with the cells; 
25 determining whether the predicted jitter satisfies the threshold 

criterion associated with the decision point; 

sending the cells to a buffer coupled to the queue if the predicted 

jitter satisfies the threshold criterion; and 

continuing to accumulate at the queue a number of cells 

30 corresponding to a next decision point.; and 

encapsulate the cells at the buffer. 
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1 1 The system of Claim 1 0, wherein the processor operates to: 

predict jitter associated with the cells comprises predicting a number of packets at 

the buffer; and _ _ 

det.rn.me whether .he predicted jitter satisfies the threshold entenon assoc.ated 

5 with the decision point comprises determining whether the predicted number satisfies the 
threshold criterion, the threshold criterion describing a threshold number of packets a, the 
buffer. 

12. The system of Claim 10, wherein the processor operates to predict jitter 

1 0 associated with the cells by: 

accessing a fill time matrix associated with another queue, the fill ..me matm 
comprising a plurality of fiH times, each fill time associated with a se, of packets sen. to 

the buffer from the other queue; 

determining a current number of packets at the buffer; and 
, 5 predicting the number of packets according to the current number of packets at the 

buffer and the fill time matrix in order to predict the jitter associated with the cells. 

13. The system of Claim 10, wherein the processor operates to predict jitter 

associated with the cells by: 
20 accessing a plurality of fill time matrices associated with a plurality of other 

queues, each fill time matrix comprising a plurality of fill times, each fill time assoc.ated 
with a set of packets sent to the buffer from the associated other queue; 
determining a current number of packets at the buffer; and 

predicting the number of packets according to the current number of packets at the 
25 buffer and the fill time matrices in order to predict the jitter associated with the cells. 
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14. The system of Claim 10, wherein the processor operates to calculate a fill 

time matrix associated with another queue by: 

calculating a waiting period between encapsulating at a current decision point and 

encapsulating at a next decision point; 

determining information about a plurality of sets of packets sent to the buffer from 
the other queue during the waiting period, each set of packets associated with a fill time; 
and 

storing the information in the fill time matrix, the fill time matrix used to predict 
the jitter associated with the cells. 

15. The system of Claim 10, wherein the processor operates to encapsulate the 
cells at the buffer by encapsulating the cells to generate a multi-protocol encapsulation 
section. 

15 16. The system of Claim 10, wherein the processor operates to encapsulate the 

cells at the buffer by: 

generating an encapsulation section by adding a section header and a section footer 

to the cells; and 

packetizing the encapsulation section into a plurality of packets, each packet 
20 comprising a packet header and a packet footer. 

1 7. The system of Claim 10, wherein: 

each decision point comprises an optimized efficiency; and 

the processor is operable to encapsulate the cells at the buffer by encapsulating the 
25 cells at a maximized efficiency. 

18. The system of Claim 1 0, wherein the cells comprise traffic selected from a 
group consisting of video traffic, voice traffic, and real-time traffic. 



BNSOOCIO: <WO 031 03241 AlJ_> 



WO 0J/10J24I 



PCT/US03/14827 



5 



28 

1 9 A system for encapsulating cells, comprising: 

means for receiving a plurality of cells at a queue, the queue associated with a 
plurality of decision points, each decision point corresponding to a number of cells, each 
decision point associated with a threshold criterion; 

means for repeating the following until satisfying a threshold criterion: 

accumulating at the queue a number of cells corresponding to a decision 

point; 

predicting jitter associated with the cells; 

determining whether the predicted jitter satisfies the threshold criterion 

10 associated with the decision point; 

sending the cells to a buffer coupled to the queue if the predicted jitter 

satisfies the threshold criterion; and 

continuing to accumulate at the queue a number of cells corresponding to a 

next decision point. 
1 5 means for encapsulating the cells at the buffer. 



BNSDOCID: <WO 03 1 03241 A 1 _J_> 



WO 03/103241 



PCT/US03/14827 



29 



20 A method for encapsulating cells, comprising: 

receiving a plurality of cells at a queue, the queue associated with a plurality of 
decision points, each decision point corresponding to a number of cells, each decision 
point associated with a threshold critenon describing a threshold number of packets at a 

5 buffer coupled to the queue; 

calculating a plurality of fill time matrices associated with a plurality of other 
queues by calculating a waiting period between encapsulating at a current decision point 
and encapsulating at a next decision point, determining information about a plurality of 
sets of packets sent to the buffer from the other queue during the waiting period, each set 
10 of packets associated with a fill time, and storing the information in the fill time matnx. 

repeating the following until satisfying a threshold criterion: 

accumulating at the queue a number of cells corresponding to a decision 

point; 

predicting jitter associated with the cells by predicting a number of packets 
1 5 at the buffer by accessing the fill time matrices, determining a current number of packets 
at the buffer, and predicting the number of packets according to the current number of 
packets at the buffer and the fill time matrices in order to predict the jitter associated with 
the cells; 

determining whether the predicted number satisfies the threshold criterion; 
20 sending the cells to the buffer if the predicted jitter satisfies the threshold 

criterion; and 

continuing to accumulate at the queue a number of cells corresponding to a 

next decision point; and 

encapsulating the cells at the buffer by generating an encapsulation section by 
25 adding a section header and a section footer to the cells, and packetizing the encapsulation 
section into a plurality of packets, each packet comprising a packet header and a packet 
footer. 
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